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TELEVISION/INTERNET TERMINAL USER INTERFACE 

RELATED APPLICATION DATA 
This application is a continuation-in-part of applications Sen No. 09/099,118, 
5 filed June 17, 1998, entitled "Communicating Logical Addresses of Resources in a 
Data Service Channel of a Video Signal," and Ser. No. 09/099,481, filed June 17, 
1998, entitled "Combining Real-Time and Batch Mode Logical Address Links," the 
disclosures of which are incorporated by reference. 

10 FIELD OF THE INVENTION 

The present invention relates generally to user interfaces for interactive 
television which facilitate switching between viewing a television program and 
viewing content related to that television program. 

15 BACKGROUND OF THE INVENTION 

The Internet is a well-known, global network of cooperatively interconnected 
computer networks. The World Wide Web ("WWW" or "Web") portion of the Internet 
is a collection of interconnected server computers hosting World Wide Web sites 
(referred to as "Web sites") on the Internet. A Web site consists of stored electronic 

20 documents ("Web pages" or "Web content") written in a hypertext mark-up language 
("HTML") format and containing references to numerous dependent documents. 
Web pages can be accessed by a computer user having a connection to the 
Internet. There are millions of Web sites on the Internet, providing an enormous 
spectrum of content, including content relating to popular television shows, specific 

25 episodes, and popular television characters, and other content desirably associated 
with a television program by advertisers, producers, or broadcasters (together, 
"related content" or "auxiliary data"). 

A Uniform Resource Locator ("URL") identifies the location of a document on 
the Internet. For example, URLs beginning with the prefix " http.7/www " identify Web 

30 sites and content within the Web sites. Internet content, especially Web content, is 
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frequently identified by URL during television programs or commercial 
advertisements. 

Typically, individuals access the Internet from personal computers by way of 
software such as an Internet browser, which can be integrated with the operating 

5 system of a computer, or packaged as a separate application program. An Internet 
browser provides a graphical user interface to the Internet by interpreting and 
displaying Internet content, and supporting user navigation of the Internet. 

With the advent of Internet terminals, such as those pioneered by WebTV 
Networks, Inc., persons without access to a personal computer are also able to 

1 0 access the Internet. Internet terminals work in conjunction with a standard television 
("TV") set to display Internet content. Using a user input device such as a remote 
control or keyboard, a user can navigate the Internet through an Internet terminal. 
Existing WebTV Internet terminals allow a user alternately to watch TV or browse 
the Internet. A user cannot simultaneously watch TV and browse the Internet. 

1 5 Further, no graphical user interface facilitates a user switching between watching TV 
and browsing the Internet for related content. 

Alternative mechanisms for packaging related Internet content with a 
television program have been offered. These mechanisms include encoding related 
content into a broadcast television signal, for example the Intercast Industry Group's 

20 Intercast technology, and encoding a URL into a broadcast television signal, with 
Internet content subsequently downloaded from the Internet using the URL, for 
example systems provided by WebTV and ACTV. 

The Intercast user interface allows a user to view simultaneously a television 
program and Internet content. The television program is displayed in a reduced 

25 format window. Related content is displayed in a separate window and browsed off- 
line through a navigation mechanism in a third window. The windows for displaying 
and navigating Internet content fill a significant portion of the available screen 
space. In allowing simultaneous viewing of television and Internet content, the 
Intercast user interface significantly reduces the television viewing space. Further, a 

30 viewer of television may find the display of related content in a separate window to 
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be obtrusive or distracting. The Intercast user interface does not unobtrusively 
notify a viewer that related Internet content is available for viewing. Moreover, 
although a viewer desirably is allowed to switch easily between full screen viewing 
of television and related content, the Intercast user interface does not unobtrusively 
5 provide a graphical control panel to enable such seamless switching. In addition, 
the Intercast user interface does not facilitate a user desirably selecting between 
displaying related content of interest or displaying no related content at all. 

The ACTV user interface synchronously displays a television program and 
timestamped related content. The television program is displayed in a reduced 
1 0 format window on the display screen, with the related content displayed adjacently. 
Alternatively, the television program and related content are displayed on separate 
display screens. In addition, the ACTV user interface includes on a portion of the 
display screen a control panel with a list of URLs that have been broadcast and 
received by the ACTV system. The control panel may also display URLs for which 
15 content is not synchronously displayed but is nonetheless relevant. 

In the ACTV user interface, the control panel and window for displaying 
Internet content fill a significant portion of the available screen space. Although an 
alternative design with separate display screens is offered, many viewers do not 
have two display screens. In addition to significantly reducing the television viewing 
20 space for most viewers, the ACTV user interface does not unobtrusively notify a 
television viewer that related content is available for viewing, or provide an 
unobtrusive graphical user interface to facilitate seamless switching between full 
screen viewing of television and related content. Moreover, because the ACTV user 
interface synchronously displays Internet content, the ACTV user interface does not 
25 facilitate a user desirably selecting between displaying related content of interest or 
displaying no related content at all. 

SUMMARY OF THE INVENTION 
In accordance with embodiments of the present invention, the above- 
30 described and other drawbacks of the prior art are overcome. 
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A preferred embodiment of the present invention includes a graphical user 
interface for interactive television viewing of a television program and related 
content. The graphical user interface enables access to related content without 
displaying the television program in a reduced format window. The graphical user 
interface accomplishes this by unobtrusively notifying a television viewer that related 
content is available for viewing, and upon viewer demand providing an unobtrusive 
control panel that facilitates switching between television and related content. In 
this way, a user knowledgeably and desirably distinguishes between related content 
to be displayed and related content not to be displayed. 

In an illustrated embodiment of the present invention, a graphical user 
interface facilitates a user switching between viewing a television program and 
viewing related Internet content. While watching a television program, an icon 
appears on the screen of a display device indicating that a logical address link is 
available to related content. In one embodiment of the present invention, for 
example, a WebTV user interface displays a translucent "i" icon in the upper right 
hand corner of the television screen if a URL for a Web page relating to the viewed 
television program has been received. 

If the user actuates a certain button on a user interface selection device, a 
panel appears on the screen displaying graphical control objects and a description 
of the related content. If the user actuates one type of graphical control object, the 
panel disappears. If the user actuates another type of graphical control object, the 
logical address link is followed to retrieve the related content, and the related 
content is displayed. While the related content is being retrieved, the television 
signal may be displayed in a reduced format and a progress indicator displayed until 
the related content is displayed. 

For example, if the user actuates the "Go" button on a WebTV remote control 
while the icon is displayed, a translucent panel is displayed. The translucent panel 
includes a descriptor for the Web page and two control buttons, one for ending the 
panel display and the other for linking to the Web page. If the linking button is 
actuated using standard WebTV user interface and control techniques, the Web 
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page and its dependencies are downloaded, a graphical progress indicator appears 
on the screen and the television signal is displayed in reduced form. After the Web 
page is downloaded, it is displayed. 

In an alternative embodiment of the present invention, the icon signaling the 

5 availability of a logical address link is displayed for a fixed period of time on the 
display screen before disappearing. The graphical user interface may also display 
an icon only if it has been determined that the icon has not previously been 
displayed for a particular logical address link to related content. In this way, the icon 
is not redisplayed for the same logical address link. In addition to signaling the 

1 0 viewer about content available over the Internet, the icon may signal the availability 
of content stored on a CD-ROM or other accessible mass storage device, or on an 
intranet server or other network. 

The panel can include additional graphical control objects. For example, the 
panel may include a graphical control object for saving the described logical address 

15 link to related content into an archival folder. The archival folder can then be 
browsed at a later time, and a logical address link within the folder followed. A 
graphical control object for displaying a list of recently provided logical address links 
and allowing the user to select and follow a displayed logical address link can 
likewise be provided. The panel may include a graphical control object for 

20 displaying a list of previously retrieved content and browsing the content. 

Although retrieved related content is displayed instead of the television 
program in one embodiment of the present invention, in another embodiment, the 
television program continues to be displayed along with the retrieved related 
content. 

25 Additional features and advantages of the invention will be made apparent 

from the following detailed description of an illustrated embodiment, which proceeds 
with reference to the accompanying drawings. 
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BRIEF DESCRIPTION OF THE DRAWINGS 
Figure 1 is a diagram illustrating several client systems connected to a server 
system. 

Figure 2 is a diagram illustrating a client system in which an illustrative 
embodiment of the present invention is employed. 

Figure 3 is a block diagram illustrating exemplary functional units of a set-top 
box according to one embodiment of the present invention. 

Figure 4 is a flow diagram illustrating a method of transporting logical address 
links according to one embodiment of the present invention. 

Figure 5 is a diagram illustrating a television program displayed on a screen 
of a display device, according to one embodiment of the present invention. 

Figure 6 is a flow diagram illustrating link reception processing according to 
one embodiment of the present invention. 

Figure 7 is a diagram illustrating an icon displayed in addition to the television 
program, signaling to a viewer the availability of a logical address link to related 
content, according to one embodiment of the present invention. 

Figure 8 is a flow diagram illustrating user input processing according to one 
embodiment of the present invention. 

Figure 9 is a diagram illustrating a panel displayed in addition to the television 
program, in response to viewer indication of interest in the related content, 
according to one embodiment of the present invention. 

Figure 10 is a diagram illustrating a television program displayed in a reduced 
format along with a progress indicator, in response to viewer indication of desire to 
retrieve the related content, according to one embodiment of the present invention. 

DETAILED DESCRIPTION OF AN ILLUSTRATED EMBODIMENT 
For expository convenience, the present invention is described with reference 
to an illustrative embodiment, namely a WebTV Internet terminal. It will be 
recognized, however, that the invention is not so limited. 
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System Overview 

Figure 1 illustrates a basic configuration of an Internet system network in 
which one embodiment of the present invention can be implemented. A number of 
clients 1 are coupled to a modem pool 2 via direct-dial, bi-directional data 
5 connections 29. These connections can be telephone (POTS, i.e., "plain old 

telephone service"), ISDN (Integrated Services Digital Network), cable, satellite, etc. 

The modem pool 2 is coupled through a router, such as that conventionally 
known in the art, to a number of remote servers 4 via a conventional network 
infrastructure 3, such as the Internet. The Internet system includes a server 5, 
10 which specifically supports the clients 1 . The clients 1 each have a connection to 
the server 5 through the modem pool 2 and the Internet 3. 

Embedding of Logical Address Links 
Various embodiments of the present invention will be described with 

1 5 reference to logical addresses that are embedded within a broadcast television 

signal. The logical addresses may provide "links" to Internet, Web, or other local or 
remote content related or unrelated to a program being broadcast. A form of logical 
address (also referred to as a resource locator) commonly associated with Web 
content is a Uniform Resource Locator ("URL"). A URL is a compact string 

20 representation of a location used to identify an abstract or physical resource on the 
Internet. Of course, alternative means of uniquely identifying content may be 
employed. For example, it is appreciated that keys (e.g., database indices), network 
addresses (e.g., IP addresses), and other identification mechanisms, alone or in 
combination, may be employed to uniquely identify a resource. Therefore, while the 

25 term URL refers to a specific type of content identifier used in connection with the 
Web, the terms logical address and/or resource locator are used herein to refer to 
content/resource identification mechanisms generally. 

Links to Internet/Web content provide an easy and powerful way to bring the 
richness and interactive nature of the Internet to TV. Such links may be used by 

30 program producers, program sponsors, networks, local affiliates, and other content 
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providers to link TV viewers to web content specifically designed to complement 
what the viewers are watching on TV. Various embodiments of the present 
invention provide and transmit logical addresses that identify content (e.g., Internet 
content) within a video signal. For example, content providers can transmit URLs to 
5 viewers by inserting URL data, in a predetermined syntax, within line 21 of the 
vertical blanking interval of an analog television signal. Other known data 
embedding techniques can also be used. 

According to one aspect of the present invention, on receipt of a logical 
address in a TV signal, an icon or some other visual indication is presented to the 

1 0 viewer to notify the viewer of the availability of Internet content. The viewer can 
then select the visual indication to view the content concurrently with the TV 
broadcast or save the logical address for later viewing. 

Logical addresses embedded in video may refer to content stored on a CD- 
ROM or other mass storage device, an Intranet server, or other resource. 

15 Additionally, certain aspects of the invention described herein are equally applicable 
to other TV viewing devices, such as personal computers equipped with TV tuners, 
and the like. Moreover, while various embodiments of the present invention will be 
described with reference to an NTSC broadcast video signal, other broadcast TV 
systems are equivalent for the purpose of the present invention, such as Phase 

20 Alternate Lines (PAL), Sequential Couleur Avec Memoire (SECAM), and the 

proposed High Definition Television (HDTV) standard. Finally, it is appreciated that 
a variety of other transport mechanisms can be employed, including digital satellite, 
digital TV, and cable TV. 

25 An Exemplary Client System 

Figure 2 illustrates an Internet system client ("client") 1 known in the art. The 
client 1 includes an electronics unit 10 (hereinafter referred to as "the set-top box 
10"), an ordinary television set 12, and a user interface selection device 11. (In an 
alternative embodiment of the present invention, the set-top box 10 is built into the 

30 television set 12 as an integral unit.) In the embodiment depicted, the client 1 uses 
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the television set 12 as a display device for displaying video data and a graphical 
user interface. The set-top box 10 is coupled to the television set 12 by a video link 
6. The video link 6 is an RF (radio frequency), S-video, composite video, or other 
known form of video link. 

The set-top box 10 includes hardware and/or software for receiving and 
decoding a broadcast video signal 8, and providing video data to the television set 
via video link 6. The set-top box 10 also includes hardware and/or software for 
providing the user with a graphical user interface, by which the user can access 
various Internet services, browse the Web, send e-mail, and otherwise access the 
Internet. 

User interface selection device 1 1 allows the user to control the client 1 in 
browsing the Web, sending e-mail, and performing other Internet-related functions. 
In an illustrated embodiment, user interface selection device 11 is a hand-held 
remote control. In alternative embodiments, a wireless keyboard, keyboard, or other 
input device is operated by the user in order to control the client 1 . The set-top box 
10 receives commands from user interface selection device 11 via an infrared (IR) 
communication link. (In alternative embodiments, the link between the user 
interface selection device 11 and the set-top box 10 may be RF or other known 
mode of transmission.) 

Figure 3 is a block diagram further detailing the set-top box 10. As shown, 
set-top box 10 includes a CPU 21, ROM memory 22, RAM memory 23, an infrared 
interface 24, a television interface 31, an audio DAC 25, a video encoder 26, a 
telephone modem 27, an ISDN modem 30, mass storage 28, and an ASIC 20. 

ASIC 20 serves as a bus coupling the other illustrated components, under the 
control of CPU 21 . In some embodiments, ASIC 20 also includes dedicated video 
processing circuitry that shrinks the size of the displayed television broadcast so as 
permit display of user interface elements, as more particularly detailed below. 
(Techniques for shrinking the size of a displayed television signal are known in the 
art, so are not belabored here.) 
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The infrared interface 24 receives signals from the remote control 1 1 and 
provides corresponding data to the set-top box. The television interface 31 receives 
broadcast video signals, such as an NTSC video signal, and extracts embedded 
data. The extracted data, or a portion thereof, can be displayed concurrently with a 
television program For example, in one embodiment of the present invention, titles 
corresponding to logical addresses that have been inserted into a text mode data 
service or a captioning data channel of line 21 of the VBI are extracted by the TV 
interface 31 and displayed on the TV 12. An exemplary syntax for transporting 
logical addresses in line 21 of the VBI is described below. 

Read-Only Memory 22 provides storage of program code for implementing 
application software to be executed by the set-top box 10. Memory 22 may be a 
programmable ROM (PROM) or any form of erasable PROM (EPROM) or Flash 
memory. Mass storage device 28 is optional, and can be used to input software or 
data to the client, or to download software or data received over network connection 
29 or data embedded in broadcast signal 8. The mass storage device 28 can 
include any suitable medium for storing machine-executable instructions, such as 
magnetic disks, optical disks, and the like. 

Syntax and Usage of Logical Address Links 
Having described an exemplary environment in which embedded logical 
addresses may be employed, logical address links, their syntax, and usage will now 
be discussed. Generally, logical address links, such as TV Crossover Links™, 
enable seamless integration of television programming and the Internet by allowing 
Internet content to be associated with a television broadcast. (TV Crossover Links™ 
is a trademark of WebTV Networks, Inc. of Palo Alto, California.) 

In one embodiment, client 1 allows Web content and television programming 
to be concurrently displayed as described in co-pending patent application number 
09/087,354, entitled "Method and Apparatus for Displaying Hypertext Mark-up 
Language and Video Simultaneously" filed May 29, 1998, assigned to the assignee 
of the present invention and incorporated herein by reference. 
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Associations between a television broadcast and Internet content can be 
performed in real-time or in batch mode. Real-time logical address links are sent to 
the TV viewer's client system during a television broadcast, e.g. in line 21 of the VBI. 
In contrast, batch mode logical address links are delivered to the client system in 
5 advance of the television broadcast to which they relate. For example, batch mode 
logical address links can be downloaded from a Web server to the user's client 
system or delivered on CD-ROM or other computer readable medium. Batch mode 
logical address links can also be delivered as part of an electronic programming 
guide (EPG) and may be modified and/or supplemented with real-time logical 

10 address links. 

While real-time logical address links are valid for a predetermined amount of 
time after receipt by the client system, batch mode logical address links typically 
define a time interval. For example, a batch mode logical address link may include 
a start time and an end time indicating when the link is to be made available to the 

1 5 viewer. 

Logical addresses can be transmitted in one of the text service channels of 
line 21 , i.e., First Text Service (T1), Second Text Service (T2), Third Text Service 
(T3), or Fourth Text Service (T4), or one of the captioning data channels of line 21, 
i.e., Primary Synchronous Caption Service (CC1), Special Non-synchronous Use 
20 Captions (CC2), Secondary Synchronous Caption Service (CC3), or Special Non- 
synchronous Use Captions (CC4), by using the following encoding format for logical 
address strings on line 21 of the VBI: 

<bgical address> [attributei:valuei] [attribute2:value2] ... [attributen'valuen] [checksum] 

25 The logical address (e.g., a URL) is enclosed in angle brackets. One or more pairs 
of attributes and values may follow the logical address in square brackets. Finally, a 

checksum follows the n*h attribute/value pair in square brackets. It is appreciated 
that delimiter characters other than angle brackets and square brackets may be 
employed. However, it is important to avoid employing delimiters that are included 
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in the URL character set. Additionally, it is preferable that the delimiter be present in 
both the standard EIA-608 character set and the US-ASCII character set to make 
logical address links relevant to the widest set of devices. 

Exemplary attributes include type and name . The type attribute indicates to 
5 what the content relates. For example, the content may be related to the current 
television program, to the broadcast network, or to one of the commercial sponsors 
of the current TV program. Table 1 lists exemplary values that may be associated 
with the type attribute. 





Type Attribute Value 


Related to 




PROGRAM 


the current program 




NETWORK 


the broadcast network 




STATION 


the local station 


jf-S 


SPONSOR 


a commercial sponsor of the current 






program 




OPERATOR 


the service (e.g., cable or satellite) 
operator 



m 10 

m Table 1 : Meaning of Type Attribute Values 



The name attribute provides a concise title for the resource identified by the 
logical address. It is preferable to associate a title with a logical address since the 
1 5 logical address itself doesn't always make clear what the content of the identified 
resource is. For example, the URL 

http://www.nbc.com/tvcentral/shows/seinfeld/characters/index.html might identify a 
web page on NBC's web site that describes frequently appearing characters on the 
Seinfeld television program. Therefore, for the viewers' convenience, a value such 
20 as "Seinfeld Stars" may be associated with the name attribute for this logical 

address link. Similarly, a web page relating to guest stars, such as the web page 
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located at http://www.nbc.com/tvcentra!te^ might 
be associated with the name "Seinfeld Guest Stars." 

Other attributes can be employed as well. For example, a mechanism for 
purging old links may utilize an attribute that identifies a date or a date/time at which 
5 a logical address link expires. In this manner, after the date indicated, logical 
address links having an expired attribute may be purged from the client's memory. 

Importantly, attributes are optional and need not appear in any particular 
order. For purposes of illustration, exemplary logical address links are listed below 
(note, however, the checksums have not been calculated): 
1 0 <http7A/wwv.nbc.coT^ [name:Seinfeid Stars] 

FY8F1] 

<http://www.tvprogram.com> [type:program] [name:TV Program] [C8C5] 
<http://advsponsor.net> [type:sponsor] [name:Special Offer] [BFAO] 
<http://madkad_network.com> [type: network] [1128] 
15 <http://www.coolsite.com> [6C1D] 



It should be appreciated that logical addresses are not limited to URLs, and 
that URLs are not limited to the "http:" scheme. Therefore, the following would also 
be recognized as valid logical address links: 
20 <mailto:info@advsponsor.net>[type:sponsor][5FDB] 

<news:alt.tv.program][type:program][391B] 



A checksum is appended to the end of the logical address link in order to 
detect data corruption that may occur during receipt or transmission of the logical 

25 address link. Preferably, a two byte hexadecimal checksum is employed, such as 
that produced by the standard TCP/IP checksum algorithm described in Request 
For Comments (RFC) 719, "Internet Protocol", September 1981. The checksum can 
be computed by pairing adjacent characters in the string (starting with the first 
delimiter) to form 16-bit integers. If there are an odd number of characters, the final 

30 character is paired with a byte of zeroes. The checksum is computed such that the 
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one's complement sum of ail of the 16-bit integers plus the checksum equals the 16- 
bit integer with all 1 bits. That is, the checksum is the one's complement of the 
one's complement sum of the 16-bit integers. In this manner, fewer errors go 
undetected than in previously suggested 7-bit checksum schemes, with only a 
5 negligible increase in the logical address link's overall length. 

Various embodiments of the present invention employ transportation and 
reception of logical address links. Fig. 4 is a flow diagram illustrating an exemplary 
method of transporting logical address links. In the illustrated method, logical 
address link data to be inserted by a content provider (e.g., a program producer, 

10 broadcaster, affiliate, cable or satellite provider), is inserted into upstream video (the 
source of video onto which the new data will be encoded). At step 410, upstream 
video data is received from a previous point in the video signal distribution path. At 
step 420, a determination is made as to whether or not the current distribution point 
has one or more logical address links that are to be associated with the current TV 

15 program being transmitted. If not, processing continues with step 450. Otherwise, 
processing proceeds with step 430. 

The upstream video may or may not contain previously encoded data, such 
as logical address links, in line 21 of the VBI. Each content provider, therefore, is a 
potential re-encoding point along the distribution path. At step 430, the existing data 

20 is extracted from the captioning data channel or the text service channel of the video 
signal. Subject to certain bandwidth limitations, the content provider then embeds 
one or more logical address links into a captioning or text service packet of the video 
signal (step 440). Finally, at step 450, the video signal is transmitted to the next 
downstream receiving device(s). This process may be repeated during video signal 

25 processing at each point along the video signal distribution path. 

WebTV Television Crossover Link™ User Interface 



Referring to Figure 5, a television program 500 is displayed on the television 
set 12, as discussed above in conjunction with Fig. 2 and 3. 
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Logical address link receiving devices, such as a set-top box 10, are able to 
receive and process logical address links embedded in a broadcast video signal. 
Figure 6 is a flow diagram illustrating logical address link reception processing 
according to one embodiment of the present invention. At step 610, a broadcast 
5 video signal, such as an NTSC video signal, is received. Video data extracted from 
the broadcast video signal is passed through to the display device, e.g., a TV 12 or 
other display device, such as a computer monitor, for presentation to the viewer. 

Encoded data within a captioning or text service channel of the video signal is 
extracted at step 620. The system determines whether or not a valid logical address 

10 link is present (step 630). A valid logical address link is one that is encoded in a 
predetermined syntax, such as described earlier, and whose logical address and 
attribute/value pairs are not corrupted (as determined by a comparison of a 
checksum generated by the receiving device to the checksum accompanying the 
logical address link). If a valid logical address link is present, then processing 

15 continues with step 640. At step 640, as described below, the viewer is alerted that 
a logical address link is associated with the TV program currently being viewed. 
According to various embodiments of the present invention, this alert may be a 
visual indication, an audible signal, or a combination thereof. For example, an icon 
may temporarily be displayed in one of the corners of the display area. Additionally, 

20 a tone may accompany the icon's initial presentation. Other alert mechanisms are 
possible. In any event, continued reception and processing of the broadcast video 
signal and embedded logical address links may be achieved by returning to step 
610. Returning to step 630, if no valid logical address link is present in the video 
signal, then processing loops back to step 610 

25 Referring to Figures 6 and 7, at step 640, an icon 700 is displayed on the 

television set 12, signaling to the viewer of the television program 500 that a logical 
address link related to the television program 500 is present. The icon 700 may be 
translucent (e.g. the video luminance, only, is adjusted to form the icon per known 
techniques) so as to minimize distraction from the television program 500. Although 

30 in Figure 7 the icon 700 is superimposed on the upper right hand corner of the 
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television program 500, both the appearance and the placement of the icon 700 can 
be altered without departing from the principles and scope of the present invention. 

The display of icon 700 for a particular logical address link ends when the 
viewer indicates interest in the related content associated with icon 700. Moreover, 
5 to prevent an unwanted icon from persisting on the display screen, and to alert the 
viewer when a new or different logical address link has been received, the display of 
icon 700 may end after a fixed period of time. In one embodiment, display of the 
icon 700 lasts at most 15 seconds. In an alternative embodiment, when identical 
logical address links are repeatedly received by the receiving device 10, the icon 

10 700 is displayed only if it has been determined that the icon 700 was not previously 
displayed for a particular logical address link. In this way, the icon 700 is not 
redisplayed for the same logical address link. (The link data may be sent repeatedly 
during a program to account, e.g., for viewers tuning in after the beginning of the 
program. Viewers who have been watching since the beginning should not be 

15 alerted each time the link data is re-sent.) 

In Figure 7, the icon 700 signals the viewer that a logical address link to 
related HTML content on the Web is available. An icon might alternatively signal the 
availability of content stored on a CD-ROM or other accessible mass storage device, 
or on an intranet server or other network. 

20 Fig. 8 is a flow diagram showing how the system responds when the viewer 

responds to the alert. At step 810, a viewer indication of interest in the related 
content is received. Typically, a viewer indicates such interest by actuating a control 
on a user interface selection device 1 1 . For example, on a WebTV remote control, a 
viewer presses the "Go" button to indicate interest. As is known in the art, a variety 

25 of other mechanisms for indicating interest are available for other user interface 
selection devices. 

In response to the viewer indication of interest 810, a translucent panel 900 
(Fig. 9) is displayed 820 over the television program 500. The panel 900 includes a 
descriptor 910 of the related content (e.g. "SeinfekTs Stars," or "Seinfeld Guest 
30 Stars," as referenced above), and one or more graphical control objects 920. The 
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descriptor 910 can be transmitted along with the logical address link (e.g. as a name 
attribute of a transmitted URL), or can be obtained from another source. (The 
appearance of panel 900, it position, and contents, can be varied without departing 
from the scope of the present invention. For example, descriptor 910 can include, 
5 or consist entirely or, the raw URL, rather than an associated textual description.) 

Panel 900 gives the viewer additional information beyond the mere fact of an 
alert (provided by the icon 700). If, after receiving this additional information, the 
user wishes to pursue the associated content, the remote control device 1 1 can be 
operated to select and invoke (using known user interface selection/invocation 
10 techniques) the "Go to Web Page" graphical control object 920 on the panel 900. If 
this action is taken, the Fig. 8 flow chart proceeds from step 830 to 840, and transfer 
of the related content is initiated (e.g. downloading the web page from the Internet is 
commenced). 

In the illustrated embodiment, if the "Go to Web Page" option js selected, the 

15 system removes the panel 900 from the screen, shrinks the displayed television 
image, and introduces a bar-graph status indicator at the bottom margin of the 
screen to show process in downloading the associated content. This indicator can 
include a descriptor of the logical address link or related content being retrieved. (In 
other embodiments, the status indicator can be displayed in translucent form over 

20 the full-screen television image, or can be omitted entirely.) 

When the associated content is fully downloaded and buffered in RAM 
memory 23, the television image is replaced by display of the associated (e.g. web) 
content. (In other embodiments, the associated content does not supplant the 
television image on the screen, but is displayed, picture-in-a-picture format, within 

25 the television image. In still other embodiments, it is the television program that is 
displayed in a window within a display of the associated content.) 

If, after reviewing the additional link information provided by panel 900, the 
viewer decides not to further pursue the associated content, the "Watch TV" 
graphical control object 920 can be selected and invoked, thereby returning the 

30 screen to the television-only display of Fig. 5. 
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Control panel 900 can include additional graphical control objects 920 
beyond those shown. For example, a graphical control object can be provided for 
selectably saving the received logical address link into an archival folder. The 
archival folder can be browsed by the viewer at a later time, and desired logical 
5 address links within the archival folder can be followed. (In the WebTV user 
interface, selection of such a graphical control object saves the then-alerted URL 
into a "Favorites" folder.) 

In addition to selectably adding links to a "Favorites" folder, certain 
embodiments of the present invention automatically log all logical address links 
10 received by the system into a master list. A graphical control object 920 can be 
operated to display this list, and the viewer can select and follow a link for display. 
(In the WebTV user interface, a graphical control button 920 labeled "Recent" 
permits the viewer to peruse and follow URLs logged in the master list.) By this 
arrangement, a viewer who does not wish to interrupt present viewing of the 
15 television program, but desires later to pursue a link, can do so. 

The system can similarly list (and cache, if desired) previously-retrieved 
content, permitting the viewer to browse and quickly retrieve content presented 
earlier for display. Again, a graphical control object 920 on control panel 900 can 
call-up such a list. 

20 Returning to Fig. 8, after a linking control object is actuated 830, retrieval 

operations for the related content addressed by the received logical address link are 
initiated 840, and the display of panel 900 ends 860. While the steps of Figure 8 
illustrate one embodiment of the method of the present invention, the ordering of 
several steps in Figure 8 can be changed without departing from the principles and 

25 scope of the present invention. 

To provide a comprehensive disclosure without unduly lengthening this 
specification, applicants incorporate by reference the following patents and patent 
applications: 

U.S. Patent 5,778,181 to Hidary et al., entitled "Enhanced Video 
30 Programming System and Method;" 
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U.S. Patent 5,745,909 to Perlman et al, entitled "Method and Apparatus for 
Reducing Flicker When Displaying HTML Images on a Television Monitor;" 

U.S. Patent Application 08/755,238, filed November 22, 1996 (and now 
published as WO 98/23059); 
5 U.S. Patent Application 08/755,233, filed November 22, 1996 (and now 

published as EP 844,788); 

U.S. Patent Application 08/754,164, filed November 22, 1996 (and now 
published as EP 844,768); 

U.S. Patent Application 08/755,237, filed November 22, 1996 (and now 
1 0 published as EP 844,572); 

U.S. Patent Application 08/677,914, filed July 9, 1996 (and now published as 
WO 98/04088); 

U.S. Patent Application 08/677,915, filed July 9, 1996 (and now published as 
WO 98/01825); 

15 U.S. Patent Application 08/660,087, filed June 3, 1996 (and now published as 

WO EP 812,096); and 

U.S. Patent Application 08/660,088, filed June 3, 1996 (and now published as 
EP 811,940). 

Having described and illustrated the principles of our invention with reference 
20 to a preferred embodiment, in will be recognized that embodiments can be varied in 
arrangement and detail without departing from such principles. 

For example, while the preferred embodiment employs a software- 
programmed general purpose CPU, in conjunction with an ASIC that performs video 
processing (e.g. shrinking) functions, in other embodiments such systems can be 
25 realized entirely by dedicated hardware. 

Similarly, while the invention has been described with reference to an Internet 

terminal system, such as the WebTV® Internet terminal, it is equally applicable in 
other contexts, e.g. in accessing other stored information in other viewing systems. 
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While the foregoing disclosure has focused on systems in which the link data 
is displayed when it is received, in other embodiments this need not be the case. 
For example, link information can be stored in the set-top box, and the viewer can 
be alerted thereto (e.g. by icon 700) when certain conditions exist. For example, a 
5 link to an NBC program guide can be alerted to the user at the top- and bottom- of 
every hour, whenever the viewer is tuned to the local NBC affiliate. (Such link data 
can be transmitted to the set-top box in background fashion, using otherwise-idle 
bandwidth in the VBI or other auxiliary video channel.) 

Although the foregoing embodiments employ the same icon 700 for all alerts, 

10 in other embodiments different icons can be used. For example, different icons can 
be used to distinguish between advertising-related and programming-related 
content. The alert can also include data about the link, such as the name of the link. 
While such an arrangement is more obtrusive, some viewers may prefer the 
provision of added detail without having to invoke the control panel 900. 

15 In view of the wide variety of possible embodiments to which the principles of 

our invention can be applied, it should be recognized that the detailed embodiments 
are illustrative only and should not be taken as limiting the scope of our invention. 
Rather, we claim as our invention all such variations as come within the scope and 
spirit of the following claims, and equivalents thereto. 
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WE CLAIM: 

1 . A method of displaying a screen of auxiliary data on a screen also used 
for viewing a television signal, comprising: 

displaying the television signal full screen; and 
5 reducing the size of the displayed television signal while preparing to display 

the page of auxiliary data. 

2. The method of claim 1 which includes, after said reducing, removing the 
television signal from the screen, and displaying instead the screen of auxiliary data. 

10 

3. The method of claim 1 in which the screen of auxiliary data is a graphical 
page defined by HTML data. 

4. The method of claim 1 in which said reducing leaves a marginal area of 
15 the screen unused by display of the television signal, and the method includes 

displaying progress indicia in said marginal area indicating progress in loading said 
screen of auxiliary data. 

5. The method of claim 1 in which said preparing includes downloading said 
20 screen of auxiliary data from a remote computer. 

6. A method of operating a screen used to display both television signals and 
screens of auxiliary data, comprising: 

displaying a television signal; and 
25 displaying with the displayed television signal an icon, said icon indicating the 

availability of an associated screen of auxiliary data. 



30 



7. The method of claim 6 which includes displaying said icon for a 
predetermined period, and thereafter removing the displayed icon from the screen. 
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8. The method of claim 7 which further includes displaying said icon in 
response to data conveyed with the television signal. 

9. The method of claim 8 which further includes conveying said data M 

5 different times during in the television signal, but displaying said icon only N times, 
where N is less than M, wherein a viewer of the television signal is not unduly 
disrupted by repeated display of said icon. 

10. The method of claim 9 wherein N equals one. 

10 

1 1 . The method of claim 6 which includes triggering display of said icon at a 
predetermined time of day. 

12. The method of claim 11 which includes considering a channel of the 
15 displayed television signal in determining whether to trigger said display at the 

predetermined time of day. 

1 3. The method of claim 6 which includes: 
viewer-selecting said icon; and 

20 displaying a title of said screen of auxiliary data associated with said icon. 

14. The method of claim t3 which includes: 

indicating a viewer's desire to view said screen of auxiliary information, and 
displaying same. 

25 

15. The method of claim 13 which includes displaying, with said title, at least 
one indicia that can be activated by a viewer to indicate the viewer's desire to view 
said screen of auxiliary information. 
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16. A method of operating a screen used to display television signals, 
comprising: 

displaying a televised advertising message; 
displaying with said televised advertising message an icon; and 
5 in response to user selection of said icon, displaying additional information 

relating to the subject of said advertising message. 

17. A method of operating an internet browser associated with a television 
receiver, comprising: 

10 displaying a television excerpt on a screen, said excerpt having a page of 

additional information associated therewith; 

alerting a viewer of the television excerpt to the available page of additional 
information, and in response to a viewer selection displaying the page 
associated with said alert; 
15 compiling a log, said log including data identifying plural pages to which the 

viewer was alerted; 

in response to a request by said viewer, recalling at least part of said log to 
the screen for display; 

permitting the viewer to select a page from said log for display, said page not 
20 having earlier been displayed to the viewer; and 

displaying said selected page on the screen in response to the viewer's 
selection from the log; 

wherein a user can view a page even if it was not the page to which the 
viewer was most recently alerted, and even if it was not earlier selected for viewing. 

25 

18. The method of claim 17 in which the log additionally stores data 
identifying the television excerpt with which each of said pages is associated. 
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19. A method of operating a screen to display both television programming 
and a user interface, comprising: 

displaying television programming on said screen; 

superimposing over said television programming a user interface, said user 
5 interface including at least one feature that can be manipulated by a viewer; 

wherein the user interface is translucent, so the television programming can 
be viewed through the superimposed user interface. 

20. The method of claim 19 wherein the user interface is formed by changing 
10 the luminance of the displayed television programming to display said user interface. 

21 . A method of operating a screen used to display both television 
programming and pages of supplementary image data, comprising: 

(a) displaying the television programming on the screen; 
15 (b) alerting a viewer to the availability of a page of supplementary image data 

associated with said displayed television programming; 

(c) receiving a signal from the viewer indicating an interest in the 
supplementary image data; 

(d) responsive to said indication of viewer interest, displaying textual data 
20 related to said page of supplementary image data; 

(e) receiving a further signal from the viewer indicating a continued interest in 
the supplementary image data; and 

(f) responsive to said further indication of viewer interest, displaying said 
page of supplementary image data. 

25 

22. The method of claim 21 in which (d) includes displaying said textual data 
in conjunction with display of said television programming. 
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23. The method of claim 21 in which (d) includes displaying a user interface 
with said textual data, the user interface permitting the viewer to signal said further 
interest in viewing the supplementary image data. 

24. The method of claim 21 in which (f) includes replacing display of the 
television programming with display of said supplementary image data. 
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TELEVISION/INTERNET TERMINAL USER INTERFACE 

ABSTRACT OF THE DISCLOSURE 
A viewer of television programming is alerted to the availability of content 
5 related to the programming (e.g. an associated Internet web page) by an icon 

momentarily displayed on the screen. Using a remote control, the viewer can select 
the icon. A control panel then appears, superimposed over the television image, 
and provides additional detail about the related content By further operating the 
remote control, the viewer can select the associated content for viewing, or return to 
10 watching the television. Various other features and variations are disclosed. 
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FOR PATENT APPLICATION 

As a below named inventor, I hereby declare that: 

My residence, post office address and citizenship are as stated below next to my name, 

I believe I am the original, first and sole inventor (if only one name is listed below) or an 
original, first and joint inventor (if plural names are listed below) of the subject matter which is claimed and 
for which a patent is sought on the invention entitled TELEVISION/INTERNET TERMINAL USER 
INTERFACE, the specification of which 

[X] is attached hereto. 

[ ] was filed on as Application No. . 

[ ] was described and claimed in PCT International Application No. , 

filed on (if applicable). 

[ ] and was amended on (if applicable). 

[ J with amendments through (if applicable). 

I hereby state that I have reviewed and understand the contents of the above-identified 
specification, including the claims, as amended by any amendment referred to above. 

I acknowledge the duty to disclose information which is material to patentability as defined in 
Title 37, Code of Federal Regulations, § 1.56. If this is a continuation-in-part application filed under the 
conditions specified in 35 U.S.C. § 120 which discloses and claims subject matter in addition to that 
disclosed in the prior copending application, I further acknowledge the duty to disclose material 
information as defined in 37 CFR § 1 .56 which occurred between the filing date of the prior application and 
the national or PCT international filing date of the continuation-in-part application. 

I hereby claim foreign priority benefits under Title 35, United States Code, § 1 19(a)-(d) of any 
foreign application (s) for patent or inventor's certificate or of any PCT International application(s) 
designating at least one country other than the United States of America listed below and have 
also identified below any foreign application(s) for patent or inventor's certificate or any PCT International 
application(s) designating at least one country other than the United States of America filed by me on the 
same subject matter having a filing date before that of the application(s) on which priority is claimed: 

Prior Foreign Application (s) Priority Claimed 

[] [] 

(Number) (Country) (Day/Month/Year Filed) Yes No 

I hereby claim the benefit under Title 35, United States Code, § 1 19(e) of any United States 
provisional application (s) listed below: 



(Application No.) (Filing Date) 

I hereby claim the benefit under Title 35, United States Code, § 120 of any United States 
application(s) or § 365(c) of any PCT International application(s) designating the United States, listed 
below and, insofar as the subject matter of each of the claims of this application is not disclosed in the 
prior United States or PCT International application in the manner provided by the first paragraph of Title 
35, United States Code, § 112, 1 acknowledge the duty to disclose material information as defined in Title 
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37, Code of Federal Regulations, § 1 .56(a) which occurred between the filing date of the prior application 
and the national or PCT International filing date of this application: 



(Application No.) (Filing Date) (Status: patented, pending, abandoned) 

The undersigned hereby authorizes the U.S. attorney or agent named herein to accept and 

follow instructions from as to any action to be taken in the Patent and Trademark Office 

regarding this application without direct communication between the U.S. attorney or agent and the 
undersigned. In the event of a change in the persons from whom instructions may be taken, the U.S. 
attorney or agent named herein will be so notified by the undersigned. 

I hereby appoint the following attorney(s) and/or agent(s) to prosecute this application, to file a 
corresponding international application, and to transact all business in the Patent and Trademark Office 
connected therewith: 



Name 


Reg. No. 


Name 


Reg. No. 


Kenneth S. Klarquist 


16,445 


Stacey C. Slater 


36,011 


James Campbell 


19,978 


Garth A. Winn 


33,220 


James S. Leigh 


20,434 


Stephen A. Wight 


37,759 


Arthur L. Whinston 


19,155 


Joel R. Meyer 


37,677 


David P. Petersen 


28,106 


Joseph T. Jakubek 


34,190 


Richard J. Polley 


28,107 


Robert F. Scotti 


39,830 


Ramon A. Klitzke II 


30,188 


Gregory V. Bean 


36,448 


William Y. Conwell 


31,943 


David J. Earp 


41,401 


Mark L. Becker 


31,325 


Lisa M. Caldwell 


41,653 


William D. Noonan 


30,878 


Michael D. Jones 


41,879 


John D. Vandenberg 


31,312 


Steven D. Yates 


42,242 


John W. Stuart 


24,540 






Donald L. Stephens Jr. 


34,022 







Address all telephone calls to Stephen A. Wight at telephone number (503) 226-7391 . 
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